REMARKS 



The present amendment makes editorial changes and corrects 
typographical errors in the specification, which includes the Abstract, in order 
to conform the specification to the requirements of United States Patent 
Practice. No new matter is added thereby. Attached hereto is a Substitute 
Specification including a marked-up version of the changes made thereto via 
by the present amendment. 

In addition, the present amendment cancels original claims 1-10 in 
favor of new claims 11-24. Claims 11-24 have been presented solely because 
the revisions by red-lining and underlining which would have been necessary 
in claims 1-10 in order to present those claims in accordance with preferred 
United States Patent Practice would have been too extensive, and thus would 
have been too burdensome. The present amendment is intended for 
clarification purposes only and not for substantial reasons related to 
patentability pursuant to 35 U.S.C. §§101, 102, 103 or 112. Indeed, the 
cancellation of claims 1-10 does not constitute an intent on the part of the 
Applicants to surrender any of the subject matter of claims 1-10. 



Early consideration on the merits is respectfully requested. 

RespectAlly subnfftted. 




William E. Vaughan 



Reg. No. 39,056 
P.O. Box 1135 



Chicago, Illinois 60690-1135 
(312) 807-4292 



Dated: December 3. 2004 



34 



Marked-Up Version of Substitute Specification 
SPECIFICATION 
TITLE OF THE INVENTION 
TRANSMISSION OF MMS MESSAGES WITH 
5 THE CONVERSION OF DATA TYPES AND/OR DATA FORMATS 

BACKGROUND OF THE INVENTION 
Th e present inv e ntion relates to a m e thod for transmitting data 
according to the preamble of Claim 1, a send e r and/or receiver terminal, a 
computer program product and a communications system. The use of the term 
10 data in the present invention includes all types of information that can be 
compiled from the individual components. The individual components or 
elements can be structured, organized and/or coded according to different 
standards. Accordingly, data can represent multimedia messages that comprise 
include d iverse elements with different standards. 
15 Methods and apparatus for transferring various data types or formats 

are known. For example, in addition to voice telephony, a mobile radio system 
as per the Global System for Mobile Communications Standard GSM already 
offers the option of sending or receiving information in the form of text 
messages up to 160 characters long. This service is known as the Short 
20 Message Service SMS. 

For next-generation mobile radio systems, such as the Universal Mobile 
Telecommunication System UMTS, a multimedia-capable version of the 
mobile messaging service is currently being standardized. This service is 
known as the Multimedia Messaging Service MMS. The Multimedia 
25 Messaging Service MMS specifies mechanisms to transport various content 
from one subscriber of the service via a network to another subscriber. In this 
document, messages with multimedia content will be known simply as 
multimedia messages MM to better differentiate them from SMS text 
messages. By contrast with the SMS, there is no restriction to pure text content 
30 with the Multimedia Messaging Service MMS. In the MMS, it is also also will 
be possible to format texts however you like d esired and embed- to embed any 
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content in a message. This includes audio and video content, graphics and text. 
The individual multimedia components of a multimedia message, also known 
as MM elements, ean-also may contain references to other data known as links. 
Data referenced in this way ean-either can be integrated into the multimedia 
5 message MM as an additional MM element or can be stored in external 
memory space for downloading4atef; jater; for exampl e example, on a server 
in a network. 

The disclosure below refers- refers, in general -general to data quantities 
comprising having individual elements of text and/or image data with or 
10 without sound that are coded to the same or different standards even though the 
application of the aforementioned standard is a key area of application for the 
present invention. 

A communication system for transmitting this type of data essentially 
compris e s includes three layers: a layer of a data sender with an MMS user 

15 application or an MMS user agent, a layer of at least one service provider 
whose network element triggers the service and is hereinafter referred to as an 
MMS connection unit or MMS relay/server, and lastly a layer of a receiver 
with an appropriate MMS user application. The term MMS user application 
covers an application on both the sender and receiver-side^ - side; for exampl e 

20 example, on a mobile phone that implements MMS functionality. 

Usually, a mobile phone equipped with an MMS user application does 
not support all the existing data types or data formats. Current developments 
indicate a greater number of different data formats for various special 
applications that m -in the future may be of interest as elements of a multimedia 

25 message. Upgrading all subscriber terminals can practically be excluded due to 
the high numbers involved and the high software maintenance intervals 
dictated by development. It can be assumed that an MMS user application in a 
subscriber terminal ean-therefore can only ever process a selection of the 
growing number of different data formats. The information as to which data 

30 types and data formats are supported by a particular MMS user application (in 
addition to other individual features of the MMS user application) is part of the 
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MMS user application profile or MMS user agent profile that has to be known 
to the MMS service provider before multimedia messages can be exchanged. 
For this purpose, the information is transferred at the beginning of every MMS 
session from the appropriate terminal to the network and stored there. Given 
that the information from the MMS user application profile is known to the 
MMS relay/server of the MMS service provider, this enables it to undertake 
data type conversions/code conversions and file format conversions. Only 
those data types and data formats are then forwarded to a MMS user 
application that it can process. tf-ar- If an M MS relay/server receives a 
multimedia message that comprises includes two MM elements, where the first 
MM element contains a link to the second MM element and the data type or 
data format of the second MM element has to be converted before the 
multimedia message is forwarded to the recipient in accordance with the 
information from the MMS user agent profile, then the link in the first MM 
element is errored after the conversion and em-no longer canbe resolved. 

The object of the present invention is tn propose directed toward a 
method, a sender and/or receiver terminal, a computer program product and a 
communications system that provides a data or message sender additional 
options for sending data with a higher degree of flexibility with error-free 
adaptation for every combination of data and data formats to a given 
communication system and/or MMS user application. 

According to the present invention, this object is achieved by a method 
in accordance with the featur e s of Claim 1 and a subscriber/receiver terminal 
with th e features of Claim 7. A communication system with the features of 
Claim 10 provides a possibl e solution. The subclaims define the preferred and 
beneficial embodiments of the present invention. 

SUMMARY OF THE INVENTION 
A method according to the present invention for transmitting data in a 
communication system, in particular transmitting text and/or image data with 
or without sound that is coded to the same or different standards, is 
characterized in the present invention in that data type and/or data format 
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conversion is undertaken in accordance with a profile of a receiver in which a 
link is changed appropriately to preserve the validity of this link in the data 
and/or between different data elements of the data type and/or data format 
conversion. In other words, when converting a data type and/or data format in 

5 accordance with a profile of a receiver to preserve the validity of one or more 
references in the data between different data elements, at least one link is 
updated. According to the present invention, it is therefore possible as a result 
of an automatic link update after a data type and/or data format conversion that 
internal references remain valid even after conversion of data types and/or data 

10 formats and that a multimedia message can always be completely displayed to 
the receiver in adapted form as per the sender's requirements. According to the 
present invention, both internal and external references are considered, as is 
described in an embodiment with reference to the accompanying-dfawings 
figures . 

15 In a further development of the present invention, the conversion is 

undertaken at the provider of the receiver. The resources required for such 
processing are envisaged in a message transmission network and would relieve 
relieved, in paftiewlflr- particular, t he load on the subscriber terminal in terms of 
required processing power and contribute to a reduction in energy 

20 consumption. 

In a preferred one embodiment of the present invention, a link in the 
data between the different elements is verified. This would mean Ajjudijha* 
any errors in the data structure could be detected and possibly eleared-cleared, 
but in any case notified to the sender. In one embodiment embodiment, a 
25 decision eaa-then can b e made as to whether the damaged or errored data 
record should be transmitted or deleted and resent by the sender. 

The data for transmission weuld-preferably would b e prepared such that 
it contains a header to transport organization information and a body to 
transmit the appropriate useful information. The useful information preferably 
30 comprises mcludgselements in the form of a pteality-number of data packets. 
In a preferred oneembodiment, the data is transmitted from a user application 
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of a subscriber via a network to a user application of another subscriber in 
which the transmission is controlled by transactions and/or information 
elements of a transport protocol added to the data, whereby the information 
elements compriGc include a field name and an appropriate field value. A 
method according to the present invention is preferably used for data which is 
transmitted as a multimedia message MM in a Multimedia Messaging Service 
MMS MMS; in parti cular - particular, on a mobile subscriber terminal or 
specifically on a WAP-capable mobile phone as per the GSM, GPRS, EDGE 
or UMTS standard or combinations thereof. 

The Multimedia Messaging Service MMS, the preferred area of 
application of the present invention, does not currently offer any measures for 
intercepting, verifying or securely converting external references for easier 
integration of applications. With the embodiments of the present invention, it 
will be possible to adapt internal and external references by moans of y ia_a 
sending application with such a high level of reliability that it can be assumed 
that complete and secure forwarding is guaranteed. 

Additional features and advantages of the nresent invention are 
described in. and will be apparent from, the following Detailed Description of 
the Invention and the Figures. 

The present invention will now be described in more detail with 
reference to the accompanying drawings on the baoia of preferred 
embodim e nts. The drawingo ohow: 

PtRTF.F DESCRIPTION OF THE FIGURES 
Figure 1 shows a schematic diagram of an MMS network architecture 
as per 3GPPj^ 

Figure 2 a flow diagram in which the link in the first MM element has 
to be reconciled after the data format conversion of the second MM elements 

Figure 3 shows a diagram of an incoming MM in the MMSE that 
contains a link to a file that is situated on an external serverrand 
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Figure 4 shows a diagram in which a link points to a memory location 
in the MMSE of the MMS service provider after data type conversion and/or 
data format conversion. 

Elements with the same function and mode of operation are labeled 
with the same references or abbreviations in Figures 1 to 4. 

DETAILED DESCRIPTION OF THE INVENTION 
As already described at the start of this document, the Multimedia 
Messaging Service MMS enables the transmission of multimedia messages in 
which formatted text and images with or without sound can be received. The 
existing restriction in the SMS to a text message length of 160 characters is no 
longer applicable. Transmission ef-of. among other things-things, audio and 
video messages is possible, but the very frequently used SMS messages will 
continue to be processed within the system in the present invention with 
resources to match, as is described in the summary of the prior art. 

MMS can be implemented using WAP. For radio transmission of data, 
such as multimedia messages MM the communication system as shown in 
Figure 1 should be used. The diagram in Figure 1 shows a diagram with the 
prior art from the point of view of 3 GPP depicting the exchange of a 
multimedia message MM between three participating instances in sending and 
receiving an MM. This communication system 1 comprises includes a layer 2 
of a data sender, also labeled as an MMS user application A or MMS user 
agent A M-UA_A. The term MMS user application covers an application 
application, for example example, on a mobile phone that implements MMS 
functionality. Furthermore, a layer 3 of a service provider SPro is envisaged 
whose network element triggers the services and is hereinafter referred to as an 
MMS connection unit or MMS relay/server MMS-RS. An MMS relay/server 
MMS-RS is a network element that enables the MMS user application MMS- 
UA to communicate via the network in an area of responsibility or in the 
Multimedia Messaging Service Environment MMSE of the MMS service 
provider SPro and provides the MMS functionality. In this example, the 
interface between layers 2 and 3 is shown as a radio network RN A instead of a 
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dedicated network connection for transmitting a multimedia message MM1. 
Finally, a layer 4 is envisaged as a layer of a receiver that is also designated as 
an MMS user application B M-UA B. A radio network RN B is also envisaged 
here for transmitting the multimedia message MM1. 

More than just one provider SPro ean-^of eeufse-course^appear in layer 
3. This is possible because the data sender M-UA_A and the selected receiver 
M-UA B can be contracted to different providers SPro A, SPro B as shown in 
Figure 1. Furthermore, these different providers can be associated with one 
another through a third provider as a network operator. Here-Herejiowever, 
the simpler representation is shown since the precise structure of layer 3 and 
the type of transport adaptation of a message^-e^ such as from MM1 to 
MM4 MM4, etc., is of no interest for the representation of the present 
invention. 

Generally, a mobile phone equipped with an MMS user agent MMS- 
UA does not support all the existing data types or data formats. The 
information as to which data types and data formats are supported by a 
particular MMS user agent MMS-UA (in addition to other individual features 
of the MMS user agent) is part of the MMS user agent profile that has to be 
known to the MMS service provider SPro before multimedia messages MM 
can be exchanged. This information is therefore transferred at the beginning of 
every MMS session from the terminal to the network and stored there. Given 
that the information from the MMS user agent profile is known to the MMS 
relay/server MMS-RS of the MMS Service Provider SPro, this enables it to 
undertake data type conversions/code conversions and file format conversions. 
Only those data types and data formats are then forwarded to a MMS user 
agent MMS-UA that it can process. The size of a file may change considerably 
through conversion. The sub-division of data into data types represents a broad 
classification of data that belong to different media types such as audio, text or 
static images. The data fefm^foioiat^hewever-however, provides actual 
information about the coding of a certain data type such as MP3 coded audio 
file or a JPEG coded static image. The data format of a file is uniquely 
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identifiable by the extension appended to the filename. For example, a static 
image coded to the JPEG standard has the extension "jpg" after the filename. 
The file name and the extension are generally separated by a full step-stopjbr 
example: "holiday.jpg". 

If an MMS relay/server MMS-RS receives a multimedia message MM 
that comprioco includes two MM elements MM-E1, MM-E2, where the first 
MM element MM-E1 contains a link to the second MM element MM-E2 and 
the data type or data format of the second MM element MM-E2 has to be 
converted before the multimedia message MM is forwarded to the recipient in 
accordance with the information from the MMS user agent profile, the link in 
the first MM element MM-E1 is errored after the conversion and can no longer 
be resolved. 

Until aew- now, there has been no provision for converting externally 
stored files that are linked from an MM element MM-E in accordance with the 
information in a-anMMS user agent profile of the receiver B and for adapting 
the link in the multimedia message MM after the conversion. 

A multimedia message MM essentially comprises includes a header 
and optionally a body that contains the multimedia elements MM-E. Since not 
only each multimedia message MM itself but also each individual element 
MM-E of the multimedia message MM essentially compriooo includes a header 
and a body, it is also possible that a link LK for referencing a file can be 
contained either in the header of the multimedia message MM and/or in the 
header of the relevant MM element and/or in the body. A method according to 
the present invention is used in wbieh- which, for links within a multimedia 
message MMrli.e., between different MM elements MM-E), not only the data 
types and/or data formats of the MM elements are converted in accordance 
with the current MMS user agent profile of the receiver, but also the associated 
link within the MM. In a further development of this method, the 
aforementioned principle can be applied to externally stored files and their 
linlm. i.e. links: i.e., to files that afe-are^for example example, stored on a 
server EXT and are not part of the MM. 
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Two examples for the aforementioned mechanisms for coordinating 
links after conversion of data types and/or data formats are described below 
with reference to diagrams. Firstly, a case will be considered in which a link 
within a multimedia message MM between different MM elements remains 
valid after conversion. The second case concerns a link to a file stored on a 
server that is referenced from the multimedia message MM. Hare-Here, a link 
to incorporate multimedia objects is represented by way of example as a 
Uniform Resource Location or URL link. In theory, other types are-of link 
links are possible -possible, b ut because of their comparatively greater load 
during implementation, they are not considered further here. 

1 . Link within a multimedia message MM: 

A multimedia message MM that contains two MM elements MM-E1, 
MM-E2 arrives at the MMS relay/server MMS-RS of the receiver. The first 
MM element MM-E1 is an SMIL presentation; ^Le^-a presentation that is 
described in a language standardized by the World Wide Web consortium 
W3C for synchronizing multimedia contents as per [4]. The first MM element 
MM-E1 contains a link to a second MM element MM-E2zE2i T in this exampl e 
example, a file of the data type DT ^static imaged of the data format DF "GIF" 
that is characterized with the characteristic file identifier or extension "gif". 
The MMS user agent of the receiver is not however^-noi able to display this 
data format. Consequently, the MMS relay/server converts the data format DF 
of the linked file in accordance with the MMS user agent profile into another 
data format DF-j[here, for example, JPEG, characterized by the extension 
"jp g " appended to the filename- filename) b efore the presentation of the entire 
multimedia message MM to the MMS user agent. This summary is shown in 
the diagram in Figure 2. 

In accordance with the present invention, the link LK 1 to the second 
MM element MM-E2 is new-also reconciled after the conversion KONV. In 
this case, the extension in the link simply has to be adapted so that the new link 
LK 2 to the now converted element MM-E2 only differs from the old link LK 
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1 by the extension: Before conversion: LK 1 = 'Vprivat/holiday.gif ' After 
conversion: LK 2 = "/privat/holiday.jpg". 
2. External link: 

A multimedia message MM that arrives at the MMS relay/server MMS- 
RS of the receiver as per reference point 1 in the diagram of Figure 3 contains 
as reference point 2 a link LK 2 to an external memory location. In accordance 
with the present invention, before the multimedia message MM is forwarded to 
the MMS user agent of the reeeiveg -receiver, a verification is carried out as to 
whether the data type and/or the data format of the file referenced by the link 
has to be converted in accordance with the requirements of the MMS user 
agent profile. If the MMS relay/server MMS-RS detects the need for a 
conversion, it has to first read the file from the given memory location and 
buffer it in the MMSE of the MMS service provider SPro for the purposes of 
conversion as per reference point 3. 

The file converted in accordance with the MMS user agent profile ©an 
then ftot-cannot b e re-saved in the external server EXT since it must generally 
be assumed that the MMS service provider SPro does not have any write rights 
to the external server EXT. Instead, the converted file must be stored in the 
MMSE of the MMS service provider SPro in the MMS relay/server or on 
another server that is connected to the MMS relay/server but not shown in this 
diagram. 

By contrast with case 1 described above, an adaptation of the extension 
in the link is now no longer sufficient since, as a result of the new memory 
location of the converted file, the entire path has changed. Instead, the old link 
LK 1 must be completely replaced by a new link to the memory location within 
the MMSE of the MMS service provider SPro. This reconciliation of the link 
must occur before the multimedia message MM is forwarded to the MMS user 
agent of the receiver, see reference point 4 in the diagram in Figure 4. 

If the MMS user agent of the receiver wants to trigger the new link 2 in 
the multimedia message MM, it finds at the referenced memory location a file 
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converted in accordance with the requirements from the MMS user agent 
profile, see reference point 5 in the diagram in Figure 4. 
Link LK 1 - before conversion: 

http://www.external_server.de/public/pictures/holiday.gif Link LK 2 - 

after conversion: 

http://www.MMS_service_provider/pics/holiday.jpg 

In an alternative embodiment, a method is executed in which each 
external link within a multimedia message MM is automatically replaced on 
arrival in the MMSE of a MMS service provider SPro by a new link LK which 
links to a placeholder for a possible storage space in the MMSE of the MMS 
service provider SPro. Converted files can be saved to these memory locations 
in the MMSE at a later-stag^.stage; *e_e_ on request. The conversion itself in 
this embodiment ean-optionally maybe first carried out when file download is 
executed with the help of the link LK from the terminal or the MMS user 
application MMS-UA. 

To summarize, a method is proposed in which every MM that arrives at 
the MMS relay/server of the receiver is verified to see whether it contains a 
link to another file. Thio moans that As_such, where appropriate, all header 
fields in the header of the MM and in the headers of the individual MM 
elements must be verified. Furthermore, the method described usually requires 
that MM element MM-E that may contain a link, for example SMIL, html or 
txt, to be opened. Other MM elements MM-E that cannot contain references do 
not need to be opened. This affects audio files or static kaages--iniag_s_for 
example. Since the MM elements MM-E that have to be opened are-are_as a 
mle-rulg, much smaller than MM elements MM-E that do not have to be 
opened, the additional processing load in the MMS relay/server MMS-RS of 
the MMS service provider SPro is very low. With the described method, the 
MMS service provider SPro can guarantee to his/her customers that all links, 
both internal links and external links, contained in a multimedia message MM 
can be triggered in accordance with the information from the MMS user agent 
profile of the receiver B. 
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There are many benefits of a method in accordance with the present 
invention: 

Firstly, references within an MM and between different MM 
elements remain valid after any data type and/or data format conversion in 
accordance with the MMS user agent profile of the receiver in the MMS 
relay/server of the receiver. 

Secondly, it is proposed, for references from an MM to 
externally stored files, to check whether the data type and/or data format has to 
be converted in accordance with the information of the MMS user agent profile 
of a receiver by the MMS relay/server of the receiver and whether this link has 
to be adapted accordingly after successful conversion. 

With a method of the type described above, it is therefore guaranteed 
tha Hhat, in a multimedia message MM with internal links LK^-feat even after 
conversion of the data type and/or data format-that this link LK remains valid. 
Furthermore Furthermore, it is guaranteed that an MMS user agent receives 
files available for download with data types or data formats that hehe/she is in 
a position to process as a receiver application even for an MM with external 
references to files that are stored on an external server EXT and are not part of 
the MM. This is the only way to ensure that the MM ean-can_always canbe 
completely presented in a terminal and in the way in which the sender 
intended. 

The Multimedia Messaging Service MMS specifies mechanisms for 
transporting any content from a subscriber of the service via a network to 
another subscriber, with the information elements of the message that can be 
used for the message transport, the header fields, being able to be employed 
very flexibly. In summary, several options are proposed for supporting 
attractive applications for diverse known message types, including those in 
MMS, whereby the efficiency of the message flow is beneficially improved in 
that according to the present invention any multimedia message MM can be 
adapted to the facilities of the receiver and/or set up and displayed as per the 
provisions of the sender. Transmitting short text messages such as messages 
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from the Short Message Service SMS with a link to other sources a i.e. for 
e*ample such as references to external internet sites that can be called up with 
an external application such as an internet browser, poses no problem. The 
present invention also enables structure-conformant integration of known 
message flows for all known and future data formats in adapted form together 
with the appropriate benefits. 

Although the present invention has been described with reference to 
s pecific embodiments, those of skill in th e art will recognize that changes may 
be made thereto without departing fr om the spirit and scope of the present 
invention as set forth in the hereaft er appended claims. 

Background details on WAP, MMS and cited new code languages are 
summarized in the following documents: 

[1] 3 GPP TS 23.040 version 5.3.0, Release 5; Third Generation 
Partnership Project; Technical Specification Group Terminals; Technical 
realization of the Short Message Service (SMS). 

[2] 3 GPP TS 22.140 version 5.1.0, Release 5; Third Generation 
Partnership Project; Technical Specification Group Services and System 
Aspects; Multimedia Messaging Service (MMS); Service Aspects; Stage 1. 

[3] 3 GPP TS 23.140 version 5.2.0, Release 5; Third Generation 
Partnership Project; Technical Specification Group Terminals; Multimedia 
Messaging Service (MMS); Functional Description; Stage 2. 

[4] Synchronized Multimedia Integration Language, SMIL version 2.0; 
World Wide Web Consortium; W3C Recommendation; 07 August 2001. 

Furthermore, as part of the present representation of an embodiment of 
the invention, the following labels and abbreviations arc used in particular: 

4 Communication system 

3 Layer of a data s e nder 

3 Layer of a provider/s 



Layer of a rec e iv e r 



GSM Global System for Mobile Communication 
SMS — Short Messag e Service 
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UMTS Universal Mobilo Telecommunication System 
WAP Wireless Application Protocol 
WSP — Wireless Session Protocol 
MM — Multimedia m e ssage 

5 MM1 4 Multimedia message with transport adaptation 

MMS Multimedia Messaging Servic e 

MM E Element of a multim e dia messag e 

MMSEMultimcdia Messaging Sendee Environm e nt 

SMIL Presentation in SMIL /Synchronized Multim e dia Integration 

10 Languag e 

SMTP Simple Mail Transfer Protocol 

LK Link 

F Ext e rnal fil e 

BT Data typ e 

15 BF Data format 

EXT — External server 

MMS UA MMS user application 

MMS UA A MMS Us e r Agent A, Sender of an MM, Figure 1 
MMS UA B MMS User Agent B, Receiver of an MM, Figure 1 

20 MMS RS MMS connection unit / MMS relay/server 

KONV Conversion 

RN Radio Network 

SPre — Service Provid e r 
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ABSTRACT OF THE DISCLOSURE 
The present invention relates to a method for transmitting data, a 
subscriber terminal, a computer program product, and a communications 
system . The aim of the invention is to create a method, a subscriber terminal, a 
computer program product and a communications syst e m that provides a 
sender of data or of a message with additional possibilities for sending data 
with a higher degree of flexibility for the error-free adaptation of every 
combination of data and data formats to a given communications system and/or 
provides saidthe sender with an MMS user application. To this end, a data 
type and/or data format conversion (KONV) is carried out according to a 
profile of the recipient (B), whereby a respective reference (LK) to the 
maintaining of the validity f this reference (LK) is accordingly changes in the 
data and/or between different data elements of the data type and/or data format 
conversion (KONV). 
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